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INTRODUCTION 

The State Board of Education (SBE) sets goals and measures for all public Charter Schools to annually monitor 
and track performance trends. Identification and analysis of charter school performance trends provides the 
opportunity for targeted programmatic support and professional development offerings by the Office of Charter 
Schools (OCS). The measures for charter schools operating in the 2017-18 academic year include information 
from annual accountability data along with financial and operational requirements set forth in General Statute, 
SBE Policies, and the Charter Agreement. The following report provides an update on progress towards achieving 
each SBE measure target and a more in-depth analysis on charter school performance trends as measured by the 
Office of Charter School’s Performance Framework. 

SBE GOALS AND MEASURES 

At its June 7, 2018 meeting, the State Board approved updated measures specifically related to charter school 
performance under Goal 2: Every student has a personalized education, Objective 2.4: Increase the number of 
charter schools meeting academic, operational, and financial goals. 

1. Measure 2.4.1: Percentage of charter schools receiving a School Performance Grade of an A or B 

2. Measure 2.4.2: Percentage of charter schools meeting or exceeding expected annual academic growth 

3. Measure 2.4.3: Percentage of charter schools meeting or exceeding all financial and operational goals as 
measured by the Office of Charter Schools’ performance framework 

4. Measure 2.4.4a: Decrease the number of charter schools meeting the General Assembly’s definition of 
Low Performing (School Performance Grade of D or F and a school growth score of “met expected 
growth” or “not met expected growth”) 

5. Measure 2.4.4b: Decrease the number of charter schools meeting the General Assembly’s definition of 
Continually Low Performing (Identified as Low Performing two out of the last three school years) 

MEASURE ANALYSIS 

The analysis of the four measures related to public Charter School performance under the SBE Goal 2 are as 
follows: 

I. Measure 2.4.1: Percentage of charter schools receiving a School Performance Grade of an A or B 

70 of 168 (41.7%) of charter schools received a School Performance Grade of an A or B. This calculation 
does not include two (2) schools that did not have tested grades in 2017-18 and three (3) schools 
participating in the Alternative Schools’ Accountability Model. The targeted measure value was 43.5%. 
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In reporting years prior to 2017-18, statute measured charter school proficiency as being at 60% or above 
and starting the 2017-18 academic year it was changed to measure charters the same as traditional public 
schools. 

2. Measure 2.4.2: Percentage of charter schools meeting or exceeding expected annual academic 
growth 


114 of 166 (68.7%) of charter schools met or exceeded expected growth for 2017-18. This calculation 
does not include seven (7) schools that did not have growth measures reported for 2017-18. The targeted 
measure value was 75.0%. The percentage of schools has shown a decline from the previous three 
reporting years. A four-year trend of this measure is represented by Figure A below. 


Figure A. Measure 2.4.2 

Percentage of Charter Schools Meeting or Exceeding Expected 

Growth 



2014-15 2015-16 2016-17 2017-18 


Target Actual .Linear (Actual) 

3. Measure 2.4.3: Percentage of charter schools meeting or exceeding all financial and operational 
goals as measured hy the Office of Charter School’s performance framework 

162 of 172 (94.2%) of charter schools met or exceeded all financial and operational goals. This calculation 
does not include one charter school that closed at the conclusion of 2017-18. Of the 172 operating charter 
schools, the 162 that met or exceeded all financial and operational goals achieved over 80% compliance 
in operation criteria and 100% compliance in the financial criteria of the Framework. The SEE target for 
this measure was 90%. This steady improvement accompanied the increase in rigor of monitoring for 
criteria compliance and only one opportunity for correction with OCS staff monitored indicators. With 
dedicated guidance and proactive communication, we expect this positive accountability effort to continue 
surpassing the SEE goal. A four-year trend of this measure is show in Figure B below. 
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Figure B. Measure 2.4.3 
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Measure 2.4.4a: Decrease the number of charter schools meeting the General Assembly’s definition 
of Low Performing (School Performance Grade of D or F and a school growth score of “met 
expected growth” or “not met expected growth”) 

28 charter schools met the General Assembly’s definition of Low Performing, having earned either a 
School Performance Grade of D or F and a school growth score of “met expected growth” or “not met 
expected growth.” While this figure is a decrease from the previously reported 37 charter schools meeting 
this definition, it does not meet the SBE target of 25 charter schools identified as Low Performing. Table 
1 below shows a two-year trend of charter schools designated as Low Performing. 

Table 1. Measure 2.4.4b 


Academic Year 

Targeted 

Actual 

2016-17 

N/A 

37 

2017-18 

25 

28 


5. Measure 2.4.4b: Decrease the number of charter schools meeting the General Assembly’s definition 
of Continually Low Performing (Identified as Low Performing two out of the last three school years) 

28 charter schools met the General Assembly’s definition of Continually Low Performing, having been 
identified as Low Performing two out of the last three school years. This figure is an increase from the 
previous reported 20 charter schools meeting this definition and does not meet the SBE target of 9 charter 
schools identified as Continually Low Performing. Table 2 below shows a two-year trend of charter 
schools designated as Continually Low Performing. 
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Table 2. Measure 2.4.4b 


Academic Year 

Targeted 

Actual 

2016-17 

10 

20 

2017-18 

9 

28 


Table 3. State Board of Education Strategic Plan: Goals and Measures for Charter Schools 


Measure 

2014-15 

2015-16 

2016-17 

2017-18 

Target 

Actual 

Target 

Actual 

Target 

Actual 

Target 

Actual 

2.4.1 

Percentage of Charter 
Schools receiving a 

School Performance 

Grade (SPG) of an A or B 

N/A 

- 

N/A 

- 

N/A 

- 

43.5% 

41.7% 1 

2.4.2 

Percentage of charter 
schools meeting or 
exceeding expected 
annual academic growth 

75.0% 

73.4% 

75.0% 

70.4% 

75.0% 

70.1% 

75.0% 

69.2% ^ 

2.4.3 

Percentage of charter 
schools meeting or 
exceeding all financial 
and operational goals as 
measured by the Office of 
Charter School’s 
performance framework 

N/A 

32.1% 

N/A 

76.9% 

N/A 

91.0% 

90.0% 

94.2% 3 

2.4.4a 

Decrease the number of 
charter schools meeting 
the General Assembly’s 
definition of Low 
Performing"^ 

N/A 

- 

N/A 

- 

N/A 

37 

25 

28 

2.4.4b 

Decrease the number of 
charter schools meeting 
the General Assembly’s 
definition of Continually 
Low Performing ^ 

N/A 

- 

N/A 

- 

10 

20 

9 

28 


' This calculation does not include five (5) schools that did not receive a SPG of A-F in 2017-18. 

^ This calculation does not include seven (7) schools that did not have a growth score in 2017-18. 

^This calculation does not include one (1) school that closed in 2017-18. 

"^Defined as having a SPG of D or F and a school growth score of “met expected growth” or “not met expected growth.” 
^ Defined as being identified as Low Performing two out of the last three school years. 


2017-18 PERFORMANCE FRAMEWORK TREND ANALYSIS 

In 2014-15, the Department of Publie Instruetion’s Offiee of Charter Sehools (OCS) ereated the annual 
Performance Framework to serve as the standard mechanism for reporting on progress toward achievement of the 
State Board’s goal to increase the number of charter schools meeting academic, operational, and financial goals. 
The Framework provides a consolidated view of each charter school’s performance relative to operational, 
financial, and academic criteria. The operational and financial elements of the Framework are all requirements 
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outlined in General Statute, State Board policy, or the Charter Agreement. The academic elements align with the 
goals outlined in the Strategic Plan of the State Board of Education along with requirements of comparable 
measures to the LEA as adopted by the Charter Schools Advisory Board. 


The Performance Eramework reports on 46 different indicators around operational, financial, and academic 
measures. Of the 46 different reported indicators, schools were measured against a maximum of 41 criteria. Some 
measurements were not applicable to all schools, such as required EMO/CMO reporting or the renewal criteria, 
and other measurements simply did not yield a data point for some schools, such as various criteria for testing 
subgroups. Most charter schools were measured on a range of criteria between 29 - 40 measures. Two schools 
were measured on 18 criteria as they did not have tested grade levels and were not in a renewal year. 


The analysis of the 2017-18 Performance Eramework is as follows: 

1. Number of schools obtaining 80% or higher compliance with operational and financial measures 

162 of 172 charter schools, or 94.2%, achieved at or above 80% compliance with operational and 
financial measures on the Performance Eramework. Those 162 schools achieved over 80% compliance 
in operational criteria and 100% compliance in the financial criteria of the Eramework. Table 4 below 
shows the number of charter schools achieving various levels of compliance percentages and a 
classification of exceeding goals, meeting goals, or not meeting goals. Figure C provides a two year 
trend of charter schools in each classification. 


Table 4. Operational and Einancial Compliance as Measured by the Performance Eramework 


Compliance 

2016-17 Framework 

2017-18 Framework 

Classification 

Number of 
Schools 

Percent of 
Schools 

Number of 
Schools 

Percent of 
Schools 

100% 

90 

54.2% 

33 

19.2% 

Exceeding Goals 

80 - 99% 

62 

37.4% 

129 

75% 

Meeting Goals 

0 - 79% 

14 

8.4% 

10 

5.8% 

Not Meeting Goals 


Figure C. Operational and Einancial Compliance Percentages 
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2. Number of schools obtaining 80% or higher goals met by measurement category 

This section provides accountability percentages for charter schools based on the four main categories 
of the Performance Framework. The four measurement categories include operational criteria, renewal 
criteria, financial criteria, and academic outcomes. For each section, the number of charter schools 
achieving at or above 80% of standards met is reported. The compliance percentage is calculated for 
each school by the number of criteria measures met divided by the total number of criteria the school 
was measured against for the given category. 

Section: A. Operational Annual Monitoring Criteria 

162 of 172 charter schools, or 94.2%, achieved at or above 80% success in the category of operational 
annual monitoring criteria. Of the 162 schools, 78 had been in operation for less than 10 years and 84 
had been in operation for 10 or more years. All charter schools were measured against a maximum of 
21 criteria, of which some were not applicable to all schools. Table 5 shows the breakdown of charter 
schools reaching various percentage levels of accountability along with the classification of either 
exceeding, meeting, or not meeting goals. 

Table 5. Charter School Accountability Results with Operational Annual Monitoring Criteria 


Results 

2016-17 Framework 

2017-18 Framework 

Classification 

Number of 
Schools 

Percent of 
Schools 

Number of 
Schools 

Percent of 
Schools 

100% 

93 

56% 

33 

19.2% 

Exceeding Goals 

80 - 99% 

68 

41% 

129 

75% 

Meeting Goals 

0 - 79% 

5 

3% 

10 

5.8% 

Not Meeting Goals 


Section: B. Operational Renewal Monitoring Criteria 

34 of 34 charter schools, or 100%, with a renewal year of 2019 achieved at or above 80% compliance 
in the category of operational renewal monitoring criteria. The 2019 renewal charter schools were 
measured against a maximum of 7 criteria, of which some were not applicable to all the renewal 
schools. Table 6 shows the number of 2019 renewal charter schools reaching various percentage levels 
of compliance along with the classification of exceeding, meeting, or not meeting goals. 

Table 6. Charter School Accountability Results with Renewal Monitoring Criteria 


Results 

2016-17 Framework 

2017-18 Framework 

Classification 

Number of 
Schools 

Percent of 
Schools 

Number of 
Schools 

Percent of 
Schools 

100% 

10 

91% 

31 

91.2% 

Exceeding Goals 

80 - 99% 

1 

9% 

3 

8.8% 

Meeting Goals 

0 - 79% 

0 

0% 

0 

0% 

Not Meeting Goals 


Section C: Financial Compliance 

169 of 172 charter schools, or 98.3%, achieved 100% success in the category of financial compliance. 
All charter schools were measured against one criterion. 2 schools marked with the designation of 
unresolved and 1 non-compliant were deemed as non-compliant with financial goals. 
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Section: D. Academic Outcomes 


103 of 170 charter schools, or 60.6%, met at or above 80% of academic outcomes criteria. Section D 
of the Framework contained 14 criteria, of which 12 provided comparable measures where each school 
could be rated as “met” or “not met.” The 12 measured criteria were not all applicable to all schools, 
depending on the presence of reportable data points for subgroup performance, growth, and school 
performance grades. Table 7 shows the number of charter schools reaching various percentage levels 
of compliance along with the classification of exceeding, meeting, or not meeting goals. 

Table 7. Charter School Academic Outcomes Criteria 


Compliance 

2016-17 Framework 

2017-18 Framework 

Classification 

Number of 
Schools 

Percent of 
Schools 

Number of 
Schools 

Percent of 
Schools 

100% 

53 

32% 

46 

27.1% 

Exceeding Goals 

80 - 99% 

42 

26% 

57 

33.5% 

Meeting Goals 

0 - 79% 

70 

42% 

67 

39.4% 

Not Meeting Goals 


Overall Performance on Criteria 

Figure D provides a visual of the percentage of schools exceeding, meeting, or not meeting goals in 
each category of the Performance Framework. For the categories of Operational, Renewal, and 
Financial, the classification of exceeding goals indicates that charter schools were 100% compliant, 
the classification of meeting goals indicates that charter schools were between 80 - 99% compliant, 
and the classification of not meeting goals indicates that charter schools were below 80% compliant. 
For the category of Academics, the classification of exceeding goals indicates that charter schools 
met 100% of academic criteria, the classification of meeting goals indicates that charter schools met 
80 - 99% of academic criteria, and the classification of not meeting goals indicates that charter 
schools met less than 80% of academic criteria. 

Figure D. Overall Charter School Performance by Performance Framework Category 
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3. Number of individual measure criteria with 80% or higher accountability success 

This section analyzes the number and percentage of charter schools that are meeting the measure 
criteria for each section of the Performance Framework. The four measurement categories include 21 
operational criteria, 7 renewal criteria, 1 financial criterion, and 12 academic outcomes. Each section 
of analysis below provides the number of criteria that yielded at or above 80% of charter schools rated 
as compliant or meeting criteria. The percentage of charter schools compliant for each criterion was 
calculated by the number of schools rated compliant divided by the total number of schools measured 
against the criterion. 

Section: A. Operational Annual Monitoring 

17 of 21 criteria yielded a charter school compliance percentage of 80% or greater. Of the 17 criteria, 
5 criteria measured as having 100% of charter schools in compliance, 11 criteria were measured as 
having the percent of charter schools in compliance between 90 - 99%, and 1 criterion was rated with 
charter school compliance percentages between 82 - 87%. The three lowest areas of compliance were 
A7. Ojficial funded ADM is within 10% of projected (73.3%), A15. Civil and Liability Insurance 
Coverage (64.5%), and Ai7. Compliance with all health and safety requirements (39.5%). The vast 
majority of A17 issues were related to the multifaceted Return to Learn Concussions responses from 
the annual charter school self-study. 

Section: B. Operational Renewal Monitoring 

7 of 7 criteria yielded a compliance percentage of 80% or greater. Of the 6 criteria, 5 produced 100% 
renewal charter school compliance and 2 produced greater than 90% renewal charter school 
compliance. The lowest area of compliance was Bl. Graduation requirements match the approved 
charter application or approved charter application amendments (92.9%). 

Section: C. Financial Compliance 

1 of 1 criterion yielded a percentage of 80% or greater of all charter schools in compliance. 169 of 172 
(98.3%) of all charter schools are meeting financial goals. 

Section: D. Academic Outcomes 

5 of 12 criteria yielded greater than 70% of charter schools meeting the measure. Of the 12 criteria, 2 
criteria produced between 80 - 89% of charter schools meeting the measure and 3 criteria produced 
between 70 - 79% of charter schools meeting the measure. The three lowest areas of measurements 
met include DIO. White Subgroup Grade Level Proficiency is comparable to the LEA (63.3%), Dll. 
American Indian Subgroup Grade Level Proficiency is comparable to the LEA (62.8%), and D9. Black 
Subgroup Grade Level Proficiency is comparable to the LEA (66.3%). 

4. School Performance Grade data and trends 

The trend of School Performance Grades for charter schools over the past four years shows a growth 
of the percent of all charter schools attaining a grade of C or better and a decrease in the percent of 
charter schools attaining a grade of D or F. Table 8 shows a four-year trend of School Performance 
Grades by each grade, providing the number and percentage of charter schools attaining the letter. 
Table 9 shows a comparison of the percentage of charter schools obtaining a C or better and those 
receiving a D or F over the last four academic years. The trend shows that the number of schools 
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receiving a School Performance Grade of C or better is increasing over time, while the percentage of 
schools receiving a D or F is decreasing. 


Table 8. School Performance Grades Over Four Years 



2014 -15 

2015 -16 

2016 -17 

2017 -18 

Grade 

Number 

Percentage 

Number 

Percentage 

Number 

Percentage 

Number 

Percentage 

A+ng 

12 

8.5% 

12 

7.7% 

11 

6.7% 



A 

7 

4.9% 

5 

3.2% 

5 

3.1% 

15 

8.9% 

B 

50 

35.2% 

45 

29.0% 

55 

33.7% 

55 

32.7% 

C 

31 

21.8% 

50 

32.3% 

51 

31.3% 

60 

35.7% 

D 

24 

16.9% 

29 

18.7% 

28 

17.2% 

30 

17.9% 

L 

18 

12.7% 

14 

9.0% 

13 

8.0% 

8 

4.8% 

Total 

142 


155 


163 


168 


*Due to rounding, the percent of schools may not total 100%. 

*Total number of schools reflect performance grades given to charters in the given year, schools that follow the 
Alternative Accountability Model or do not serve tested grades may not be included in the total. 


Table 9. Percentage of School Performance Grades Over Three Years 



2014 -15 

2015 -16 

2016 -17 

2017 -18 

Percentage of C or Better 
Charter Schools 

70.4% 

72.3% 

74.8% 

77.4% 

Percentage of D and F 
Charter Schools 

29.6% 

27.7% 

25.2% 

22.6% 


CONCLUSION 

Overall, charter schools are making gradual gains in increasing performance trends as measured by the State 
Board of Education Goals and Measures. With the establishment of new target measures, there is opportunity to 
identify trends over time in charter school performance and develop strategic support targeted towards increasing 
the performance of charter schools in each measure. The two performance measures that show some progress 
from the prior year include the percentage of charter schools receiving a School Performance Grade of an A or B 
and decreasing the number of charter schools identified as Low Performing. The two performance measures that 
have an opportunity for growth include the percentage of charter schools meeting or exceeding expected growth 
and decreasing the number of charter schools identified as Continually Low Performing. 
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In addition to these trends of performance as measured by the State Board of Education’s goals and measures for 
charter schools, the analysis of the 2018 Performance Framework data highlights areas of growth in charter school 
compliance percentages mainly to increase the percentage of charter schools meeting 80% or greater of the 
academic outcomes in section D. The review and school submission process for criteria under section A went 
through a recalibration phase this year to ensure that the standard for compliance was equally applied and matched 
requirements outlined in General Statute, State Board policy, and the Charter Agreement. Through this 
recalibration of identifying the quality it takes to meet compliance standards, charter schools are equally held to 
higher standards around operational requirements with the goal of increasing the number of charter schools 
meeting these requirements over time. We are very happy to have surpassed the SBE goal for meeting or 
exceeding operational and financial compliance measures and expect this success to continue. 
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